Tradeoffs for reliable quantum information storage in 2D systems 
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We ask whether there are fundamental hmits on storing quantum information reliably in a 
bounded volume of space. To investigate this question, we study quantum error correcting codes 
specified by geometrically local commuting constraints on a 2D lattice of finite-dimensional quantum 
particles. For these 2D systems, we derive a tradeofi' between the number of encoded qubits k, the 
distance of the code d, and the number of particles n. It is shown that kd^ = 0(n) where the coef- 
ficient in 0{n) depends only on the locality of the constraints and dimension of the Hilbert spaces 
describing individual particles. We show that the analogous tradeoff for the classical information 
storage is ky/d^O{n). 

PACS numbers: 03.67.Pp, 03.67.Ac, 03.65.Ud 



Understanding the limits imposed on information pro- 
cessing by the laws of physics is a problem of fundamen- 
tal and practical importance. A variety of hardware- 
independent limitations on the power of computers aris- 
ing from thermodynamics, quantum mechanics, and rel- 
ativity have been identified recently P, 0, S] ■ 

In this Letter we derive a fundamental upper bound on 
the amount of quantum information that can be stored 
reliably in a given volume of a 2D space. This bound 
stems from geometric locality of quantum operations used 
to detect and correct errors as well as peculiar features 
of quantum entanglement in 2D systems. We shall model 
the information storage using the framework of quantum 
error correcting codes . Specifically, we consider a sys- 
tem of n finite-dimensional quantum particles (qudits) 
occupying sites of a 2D lattice A. For the sake of clarity 
we shall consider a regular square lattice of size ^Jn x ^Jn 
with open boundary conditions, although our results can 
be easily extended to more general 2D lattices and pe- 
riodic boundary conditions. We shall focus on codes for 
which the codespace C spanned by encoded states can be 
represented as a common eigenspace of geometrically lo- 
cal pairwise commuting 2^ projectors Hi, . . . ,n,„ such 
that 



for all a]. 



(1) 



The codespace C can be regarded as the ground-state 
subspace of a local gapped Hamiltonian 
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n„n, = n,,n„ 
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Such a code is able to encode k = log^dimC logical 
qubits. Let d be the distance of the code [25|. Our main 
result in an upper bound 

cn 



k < 



d? ' 



(3) 



Here c is a constant coefficient that depends only on lo- 
cality of the projectors defining the codespace and dimen- 
sion of the Hilbert space describing individual particles. 



The bound Eq. (O is tight up to a constant factor since 
2D surface codes [51 achieve the scaling kd^ ~ n for any 
given n and d (26l | . The bound Eq. ([3]) can be put in sharp 
contrast with the existence of good stabilizer codes [1] for 
which k/n> ci and d/n > C2 for some constants ci,C2. 
Our result implies that the distance of 2D quantum codes 
with a non-zero rate k/n is upper bounded by a constant 
independent of n. It also implies that the distance of any 
2D quantum code is at most 0{y/n) extending the results 
of [tI beyond stabilizer codes. 

The motivation for our work stems from several 
sources. Firstly, quantum error correcting codes provide 
toy models for how topological quantum order (TQO) 
can emerge in the ground states of 2D spin systems with 
short-range interactions. For example, string-net models 
introduced by Levin and Wen Q are described by Hamil- 
tonians involving a sum of commuting projectors, see 
The ground state of string-net models defined on a torus 
(or higher genus surface) has topological degeneracy and 
can be regarded as a codespace of a quantum code. Al- 
ternatively, the codespace can be chosen as an excited 
subspace corresponding to a particular configuration of 
excitations (anyons) — the approach adopted by Kitaev 
in the topological quantum computing scheme (Iflj. In 
this case the code distance is proportional to the distance 
between anyons while the bound Eq. ^ asserts that the 
number of encoded qubits is at most a constant fraction 
of the number of anyons. 

Secondly, one can interpret Eq. ([31) as a tradeoff be- 
tween degeneracy and stability that must be obeyed by 
ground states of the code Hamiltonian H. Assuming that 
H is translation- invariant, one has a stable zero tempera- 
ture phase in the thermodynamic limit if the degeneracy 
of the ground state cannot be lifted by weak local per- 
turbations below some critical value of the perturbation 
parameter. It is well known that adding a weak local per- 
turbation to H lifts the degeneracy of the ground state 
only in order Q,{d) of perturbation theory [10|. Thus a 
necessary condition for T = stability is that the dis- 
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tance d must be infinite in the thermodynamic limit. 
Then the tradeoff Eq. ([3]) impHes that the amount of 
quantum information stored per unit volume, k/n < c/d^ 
goes to zero in the thermodynamic limit. This suggests 
a possible connection between our results and the cele- 
brated holographic principle asserting that the amount of 
information that can be encoded in a volume of space M 
scales as the area of the boundary of M. 

Generalizing our techniques to quantum codes defined 
on a _D-dimensional lattice yields 



any projector Ha can be covered by a square block of size 
w X w. Let 



cn 

k< —, 



(4) 



D - 1 

As was shown in Ref. 0, the distance of any D- 
dimensional stabilizer code satisfies the bound d < 
0(n^^^^'>/^). Since the upper bound Eq. (|4]) permits 
codes with k = 0(1) and d ~ n^/" ~ n^^~^^/^, it cannot 
be tight for all values of n and d unless D — 2. Using the 
folded surface code construction ^ll| one can construct 
a £)-dimensional stabilizer code encoding 1 qubit into n 
qubits with the distance d ~ ^/n. To the best of our 
knowledge there are no examples of D-dimensional codes 
for which the distance grows faster than y/n. Therefore 
one cannot exclude the possibility that the bound Eq. ^ 
holds for any spatial dimension, although we consider this 
to be unlikely. 

It should be emphasized that throughout this paper 
the geometric locality of the constraints IIq is defined us- 
ing the standard Euclidean geometry 27|. At the same 
time, the bound Eq. ([3]) can be violated for non-Euclidean 



geometry. For example, Ref. [I4I constructed surface 
codes on general planar graphs with a constant rate k/n 
and the distance d ~ logn, see also [13|. Also, it is known 
that stabilizer codes with k = 1 and d -y/nlogn can be 
constructed on triangulations of some 4D Riemannian 
surfaces. 



see Theorem 12.4 in Ref. 
We note that even though our results cover a large 
family of 2D quantum codes on qudits beyond the stan- 
dard family of stabilizer codes, they do not include the 
important family of quantum subsystem codes 1^ 1^ . 

One can also ask about the analogue of the tradeoff 
Eq. ^ for classical information storage. In Appendix A 
we prove that any 2D classical code specified by geomet- 
rically local constraints obeys the bound 



k < 



cn 
Vd 



(5) 



Here c is a constant depending only on the dimension of 
individual particles and locality of the constraints spec- 
ifying the code. Using the mapping from ID cellular 
automatons to 2D classical codes we construct a family 
of codes with k ~ ^/n and d ^ which is quite close 
to saturating the bound Eq. 

Definitions and notations. We shall assume that 
the locality of the projectors IIq can be characterized by 
a constant interaction range w such that the support of 
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(6) 



be the projector on the codespace C. A state p is called 
an encoded state iff it has support on the codespace C, 
that is, Hp = pH = p. We shall say that a region A/ C A 
is correctable iff there exists an error correction operation 
(a trace preserving completely positive map) TZ that cor- 
rects the erasure of all particles in A/, that is, for any 
encoded state p one has 



7?.(TrM p) = p- 



(7) 



By definition of the distance any region of size smaller 
than d is correctable. 

We shall use the notation M — A\M for the comple- 
ment of a region M. For any region M C A and for any 
fixed state p let S{M) = —TrpM log pm be the von Neu- 
mann entropy of the reduced density matrix p m ■ Using 
techniques from Ref. [13] one can easily show that the er- 
ror correction condition Eq. ([7]) has the following entropic 
counterpart. 

Fact 1. If a region M is correctable then 

S{M\M) = ~S{M) (8) 

for any encoded state p. Here S{M\M) = S{MM) - 
S{M) is the entropy of M conditioned on M. 

Note that the equality Eq. ([5]) holds automatically for 
any pure state of MM which would correspond to a triv- 
ial code with k = 0. More generally, Eq. ([8]) implies that 
there exists a (virtual) partition M = AB such that any 
encoded state p is a tensor product of some fixed pure 
state held by MA and some state of B depending on p 

Ei- 

Proof. Let pj^ifj be any encoded state and Pmmc ^'^ 
purification. Define an error T — Ttm 

Qs^idj^jQ erasing 

the region M. By assumption there exists a recovery 
operation TZ such that 

T^°T{Pmmc) ^ Pmmc^ T^°T{pj^,jm®Pc) = Pmm®Pc- 
Therefore 

S{Pmmc\\Pmm ® Pc) = S{T{pmmc)\\'^{Pmm ® Pc)) 

(9) 

since the relative entropy J_s monotone decreasing under 
quantum operations, see |l9]. Using the definition of T 
one can rewrite Eq. ([9]) as 

S{Pmmc\\Pmm® Pc) = S{pmc\\Pm® Pc)- (10) 

Taking into account that Pmmc a pure state, one can 
check that Eq. (HHD is equivalent to Eq. dS]). □ 
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We begin by sketching the steps leading up to our main 
result, the bound in Eq. ([3]). Let R be the largest integer 
m such that any square block of size m x to is correctable. 
Note that R is at least Vd by the definition of the dis- 
tance. 

Consider a partition of the lattice A = ABC shown 
in Fig. [TJ The regions A and B consist of blocks of size 
R X R, so that each individual block in A and B is cor- 
rectable. The total number of blocks is roughly n/R^. 
The regions A and B have small corner regions taken out 
which make up the region C . The purpose of the region 
C is to provide a sufficiently large separation between 
the neighboring blocks in A and between the neighbor- 
ing blocks in B such that any projector Yla overlaps with 
at most one block in A and with at most one block in 
B. It guarantees that the entire regions A and B are 
correctable (see Lemma [2] below). Applying Eq. ([8]) to 
regions A and B yields 

S{A\BC) = ~S{A) and S{B\AC) ^ -S{B) (11) 

for any encoded state. Let p be the maximally mixed 
encoded state such that k — S'(A). Using Eq. (fTT|) we get 

5(A) = S{BC) + S{A\BC) = S{BC) - S{A) 

< S{C) + S{B)- S{A). (12) 

Similarly 

S'(A) = S{AC) + S{B\AC) = S{AC) - S{B) 

< S{C) + S{A)-S{B). (13) 

Adding together Eqs. (|12ll3p yields 

77 

k = 5(A) < S{C) < \C\ ^ j^. (14) 

The second step in the proof which may be less intuitive is 
to show that R> cd for some constant c depending only 
on locality of the constraints. In other words, we need to 
prove that any block of size roughly d x d is correctable. 
Our main technical tool will be the Disentangling Lemma 
characterizing entanglement properties of the maximally 
mixed encoded state proportional to the projector on the 
codespace 11. We shall prove that any correctable region 
M can be completely disentangled from the rest of the 
lattice by acting only on the boundary of the region (see 
Lemma [T] below). The disentangling operation leaves the 
region M in a pure state, so that all entropy of M can be 
"cleaned out" by acting along the boundary of M. This 
result can be regarded as a generalization of the Cleaning 
Lemma from [7| beyond stabilizer codes. For any region 
M let dM be the boundary of M, that is, the region 
covered by the supports of all projectors Ha that couple 
M with M. The following result is a simple corollary of 
the Disentangling Lemma. 

Corollary 1. Let M be any correctable region. Consider 
any regions B M and C M such that BC is cor- 
rectable and dM C BC. Then M UC is also correctable. 



The idea of the proof is illustrated in Fig. [2l Let us 
apply Corollary [1] to a square block M of size R x R. 
Choose B and C as layers of thickness w adjacent to the 
surface of M such that B C M and C C M, see Fig. O 
Since all the projectors have size at most w, the con- 
dition dM C BC is satisifed. Note that \BC\ = cwR 
for some constant c. If \BC\ < d then BC is correctable 
and Corollary [T] would imply that M U C is correctable. 
But Af U C is a square block of size larger than R which 
contradicts the choice of R. Thus \BC\ > d, that is, 
R > d/{cw) ~ d. Substituting this bound into Eq. (fTil) 
completes the proof of Eq. ([3]) . 

Let us comment on how to extend this proof technique 
to Z?-dimensional lattices. The partition A — ABC of 
Fig. [T] should be chosen such that A and B consist of 
_D-dimensional cubes of linear size R. Adjacent cubes in 
Aot: B overlap along [D — 2)-dimensional faces. Accord- 
ingly, the region C is a union of all {D — 2)-dimensional 
faces (with a thickness of order w) over all blocks in A 
and B. Note that \C\ ~ njR?, so we arrive at Eq. (fT4| . 
Repeating the same arguments as above shows that a 
cubic-shaped block M C A is correctable if \dM\ < d, 
that is, R^~^ ^ d. Substituting it into Eq. pi)) leads to 
Eq. Q. 
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FIG. 1: The partition of the lattice A = ABC. Each individ- 
ual block in A and B must be correctable. The region C pro- 
vides separation between adjacent blocks in A and adjacent 
blocks in B. It guarantees that the entire regions A and B are 
correctable. The entropic error correction condition implies 
that S{A\BC) = -S{A) and S{B\AC) = -S{B) for the max- 
imally mixed encoded state. It yields k = S{ABC) < S(C). 



In the rest of the paper we state and prove the Disen- 
tangling Lemma, provide a formal proof of Corollary [U 
and prove that a union of correctable sets that are suffi- 
ciently far from each other is also a correctable set, see 
Lemma [2j 

Definition 1. Let M C A be any region. Define the 
external boundary cJ+M as a set of all sites u € M such 
that there is at least one projector Ha acting on both u 
and M . Define the internal boundary as d-AI ~ d+M . 
Finally, define dM = d-M U d+M. 
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FIG. 2: Extending the correctability from a region AB to a 
larger region ABC. The Disentanghng Lemma imphes that 
any encoded state p can be represented as p = U 30(11 ab ® 
ilCD)UgQ, where r]AB is a pure state independent of p. It 
imphes Trc rico = pD and thus rjA ^ po = £{p), where £ is 
an 'error' erasing the region BC. If BC is correctable, one 
must be able to reconstruct p starting from £{p). Since rjAB 
is known, it means that one can reconstruct p starting from 
Pd- Therefore ABC is correctable. 



for some projectors Hab'^ andllB'jc- 

Note that some of the projectors in the above decom- 
position might be zero. 

Proof of the Disentangling Lemma. Consider a partition 
A = ABCD, where 

A = M\d-M, B = d-M, C = 9+M, D ^ M\d+M. 

By definition, M = AB and M = CD, see Fig.H Using 
Eq. ^ one can represent 11 as a product of commuting 
projectors acting on MC and CD. Then Proposition [1] 
implies that the Hilbert space of C can be decomposed 
as 



(18) 



Lemma 1 (Disentangling). Let M C A be any cor- 
rectable region. Suppose the external boundary d+M is 
also a correctable region. Then there exists a unitary op- 
erator Uqm acting only on the boundary dM such that 

UomWIm = I M {c^M I ® . (15) 

for some pure state \4>m) md some projector Tlfj. 

It follows from Eq. (|15p that Uqm disentangles any en- 
coded state 1-0) e C, that is, Uqm IV') = iV'm) ^ \ipout) 
where \ipin) — I'/'a/) is the same for all encoded states 
\ip). In particular, any encoded state p obeys the en- 
tanglement area law, that is, S{M) < \dM\ for any cor- 
rectable region M. In the case of trivial codes (fc = 0) the 
codespace is one-dimensional and thus any region is cor- 
rectable. It reproduces the entanglement area law proved 
for ground states of local Hamiltonians with commuting 
interactions in Ref . [20| . Note that the boundary dM+ is 
correctable whenever the size of the boundary is smaller 
than the distance d. One can easily check that this is the 
case for all applications of the lemma used above. 

Finally, it is worth mentioning that Iljg might not be 
representable as a product of geometrically local projec- 
tors because the unitary operator Uqm might not be lo- 
cality preserving. Similarly, the state \4>m) might lack a 
representation in terms of local commuting projectors. 

The proof of the Disentangling Lemma is based on the 
following well-known result [21]. 

Proposition 1. Consider a tripartite system ABC and 
let n — Hab^bc — ^BC^AB be a product of two com- 
muting projectors acting on AB and BC respectively. 
Then the Hilbert space of B can be decomposed as 



nB = ^nB'^®ni 



such that 



n 



en 



AB' 



n 



B''C 



(16) 



(17) 



such that 



where H^p, and n^/,^ are projectors. Since C is cor- 
rectable, the direct sum over x contains exactly one term 
— otherwise it would be possible to distinguish some or- 
thogonal encoded states by measuring x which can be 
done locally in C, see Eq. (US)). Thus one can subdivide 
C into two subsystems C = C'C" such that 



n 



en 



{x) 
MC' 



n 



{x) 

C'D^ 



(19) 



t(^) 



n - [/c (n 



MC 



n, 



CD 



(20) 



Using Eq. ^ again one can represent 11 as a product of 
commuting projectors acting on AB and BM . Applying 
the same arguments as above one arrives at 



n = UB{TlAB'®^B"M)Ul 



(21) 



where B = B'B" is a partition of B into two subsystems 
and Hab', ^b"M some projectors. Define a new 
projector 



n' = uI^uIhubUc. 



(22) 



Combining Eqs. (|20l2ip one concludes that 11' has 
a product structure with respect to the partition 
{AB'){B"C'){C"D), that is. 



n' = Hab' ® Ob" 



n 



C"D 



(23) 



for some projector Qb"C'- The error correction con- 
dition Eq. ([7]) for M implies that Hab' must be one- 
dimensional, since otherwise one would be able to find a 
pair of orthogonal codestates which can be distinguished 
by acting only on M . Thus 



n' = \(I)aB'){(I)AB'\^Qb"C' '^'^c 



D 



(24) 



for some pure state \4>ab')- As for the projector Qb"C'^ 
the error correction condition Eq. (O for M and C 
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(separately) implies that Qb"C' can be regarded as a 
codespace of an error correcting code that corrects all er- 
rors on B" and all errors on C". The no-cloning principle 
implies that Qb"C' must be one-dimensional, that is, 

n' = \(j)AB'){(l)AB'\® |?!'S"C')(0B"C'| (^nc'D (25) 

for some pm-e state \(f>B"C')- Thus the desired unitary 
operator Uqm can be chosen as 

UoM = Wb"C'UIuI (26) 

where Wb"C' is an arbitrary unitary operator disentan- 
gling the state \4>b"C')- □ 

Proof of Corollary [H Applying the Disentangling 
Lemma to the region M — AB we conclude that there 
exists a unitary operator Use and a pure state rjAB such 
that for any encoded state p one has 

p = UBc{riAB®VCD)Ulc, (27) 

where rjcD is some (mixed) state depending on p. Taking 
the partial trace of Eq. ((27)) over ABC we conclude that 
Trc'ycn = Pd- Therefore 

riA®PD^£{p), (28) 

where we introduced an 'error' £ that takes the partial 
trace over BC. If BC is correctable, there exists a recov- 
ery operation TZ such that TZo £[p) = p for any encoded 
state p. Therefore 

p^nivA(^PD)- (29) 

Since rjA is a known state independent of p, it means that 
one can reconstruct p starting from po- Therefore ABC 
is a correctable region. □ 

Our final lemma asserts that the union of two cor- 
rectable regions Mi and M2 that are sufficiently far apart 
is also correctable. Note that this statement would be ob- 
vious if the error correction would amount to the "syn- 
drome measurement" , that is, measuring eigenvalues of 
the constraints Ha and guessing the error based on the 
measured syndrome. Indeed, an error acting on a region 
Mi creates non-trivial syndrome only in a small neigh- 
borhood of Mi, so the error corrections at Mi and M2 
do not interfere with each other. Unfortunately, this in- 
tuition does not lead to a formal proof, so we need to use 
different arguments similar to the ones used in the proof 
of Lemma [TJ 

Lemma 2. Let Mi,M2 C A fee any correctable regions 
such that any projector Ha overlaps with at most one of 
A/i,il/2. Suppose that is also correctable. Then 

the region Mi U M2 is correctable. 



Proof. It suffices to prove that 

hOmi «)0Af2n-n (30) 

for any operators Omi , acting on Mi , M2 respec- 
tively. Indeed, since any projector Ha overlaps with at 
most one of Mi, M2 the regions Mi U d+Mi and M2 are 
disjoint. Let us apply the decomposition described by 
Eqs. (|22II25[) to the region Mi. It yields 

hOm, ® Om, n = /(OmJ noM.n, (31) 

where 

f{OMi) = {(I^AB' » (I)B"C'\OaB'B"\(I)AB' «> 0B"C') (32) 

and Oab'B" = UgOuxUB- Since M2 is correctable, 
Eq. jSIl) implies Eq. jSOl). □ 
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APPENDIX A 

In this section we prove the bound Eq. ^ for 2D clas- 
sical codes and demonstrate that this bound might be 
tight by inspecting properties of 2D classical codes asso- 
ciated with ID cellular automatons. 

In the classical case each site of the lattice u e A is 
occupied by a classical variable Xu that can take a con- 
stant number of values. The codespace C is a set of all 
assignments x = {x„}„gA that obey geometrically local 
constraints ni(a;) = 1, . . . ,n„j(a;) = 1. A code encodes 
k bits with the distance d iff |C| = 2^ and any pair of 
distinct codewords differ at d or more sites. Consider 
a partition A = AB, where B ~ Bi . . . Bm consists of 
square-shaped blocks of size roughly \/d x \/d such that 
the number of sites in any block Bi is smaller than d, 
see Fig. |3l We assume that the separation between the 
blocks in B is of order w, so that any constraint IIq over- 
laps with at most one block Bi. Let x,y &Che any pair 
of codewords such that x\a ~ y\A- We claim that x — y. 
Indeed, suppose x and y differ at some block Bi. Then 
there exists a codeword z € C that coincides with x in- 
side Bi and coincides with y in the complement of Bi . It 
means that z and y are distinct codewords that differ at 
less than d sites which is a contradiction. 
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Let p be the uniform distribution on C. We have 
S{B\A) = since there is a unique way to extend a 
codeword from A to B. Therefore 



k = S{p) = S{A) + S{B\A) = S{A) < \A\ 
It proves Eq. 




FIG. 3: The partition AB. 



In the rest of the section we describe a family of 2D linear 
codes associated with ID cellular automatons (CA) that 
are quite close to saturating the bound Eq. ([S]). To the 
best of our knowledge the idea of CA-based codes was 
originally introduced in Ref. [2^ . A very similar con- 
struction has also been used in Ref. [2^ as an exactly 
solvable model of a 2D spin glass. 

Let us start from considering a semi-infinite lattice A = 
Z X [0, L — 1]. Let xj € {0, 1} be a classical bit living at 
a site {i,t) £ A. We shall refer to the coordinates i and 
t as space and time respectively. Let {0, 1}^ be the set 
of all bit assignments {xl}(i^t)eA with a finite Hamming 
weight. Define a code 



Vi e Z, Vt e [0, L - 



2]} 



(33) 



Note that all constraints are linear and involve a triple of 
bits located close to each other. Clearly there is a one- 
to-one correspondence between the codewords of and 
computational histories of a ID linear cellular automaton 
(CA) with transition rules a;^ — > Accordingly, 
any codeword x G is uniquely determined by the 
restriction of x onto the first row of the lattice which 
determines the initial conditions for the CA at t = 0. It 
means that the code has 1 encoded bit per unit of 
length along the space axis. Since the code C!^ is linear, 
its distance d is just the minimum Hamming weight of a 
non-zero codeword x G C^. 

Lemma 3. Let d{p) be the distance of the code de- 
fined on a lattice of height L, where L = 2^ for some 
integer p. Then d{p) = 3^. 

Proof. Clearly consists of two independent codes de- 
fined on the even and odd sublattices of A. Let Aq be the 
even sublattice, i.e., a set of all sites (i, i) G A such that 



i + t is even. It suffices to bound the distance of the code 
restricted to Aq. Consider a partition Aq — ABCD 
where 



A = 


{{i,t) : i- 


= 


mod 4, 


t = 


mod 2} 


B = 


{{i,t) : i- 


vt = 


2 mod 4, 


t = 


mod 2} 


C = 


{{i,t) : i- 


hi = 


mod 4, 


t = 


1 mod 2} 


D = 


{{i,t) : i- 


hi = 


2 mod 4, 


t = 


1 mod 2} 



Note that each of the above sublattices is isomorphic to 
the original lattice Aq of height 2^"^. Using the transition 



rules 



one easily gets x 



t+2 



, that is, the code reproduces itself on each of 



the sublattices A, B,C, D. We conclude that 
d{p)>Td{p^l) 



(34) 



where T is the minimum number of sublattices A, B,C, D 
that can be occupied by a non-zero codeword. Simple 
combinatorial analysis shows that F > 3, that is, d{p) > 

To get the matching upper bound on d{p) consider a 
codeword x G generated starting from a state with 
a single active cell, i.e., a codeword corresponding to the 
initial conditions a;^ = Si^i. One can easily check that the 
support of X is a discrete version of the Sierpinski triangle 
fractal which has Hamming weight 3^. Thus d(p) = 3^. 

□ 

Consider now a finite lattice A = Zl x [0, L — 1] with 
periodic boundary conditions along the space axis and 
open boundary conditions along the time axis. Define a 
finite version of the code by the constraints 



i+l: 



0, 



(35) 



which must hold for all i G Z^ and for all t G [0, L — 
2]. Let us denote the corresponding code C£. We shall 
restrict ourselves only to odd values of L. One can easily 
check that for odd L the transition rule 
is essentially reversible: a pair of distinct initial states 
{x°}igZj^ and {y^jieZr can evolve into the same state 



© 1 for all i G 
thus guarantees 



after a finite number of steps iff x° 
Z^. The additional constraint Xq = 
that distinct codewords of Cj^ have distinct restrictions 
on every time slice of the lattice. By construction, the 
modified code Cf; encodes k = L — 1 bits into n = 
bits. We have computed the distance d of the code Cf; 
numerically using the exhaustive search optimization for 
odd values of L in the interval 5 < L < 23, see Fig. HI It 
was checked that for all considered values of L one has 
d — d' , where d' is the Hamming weight of a codeword 
generated starting from a state with a single active cell, 
that is, with the initial conditions x° — Si^i. Since we 
have also shown that d = d' for the semi-infinite lattice, 
see the proof of Lemma|31 it is natural to conjecture that 
d = d' for all odd values of L. Computing d' numerically 
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for lattice sizes up to L ~ 10^ we have found d! ^ 2^1-584 
which agrees perfectly with the scaling 



1.585 



,0.793 



(36) 



that was derived in Lemma [3] for the semi-infinite lattice. 
Summarizing, the code Cf" encodes k = ^/n— 1 bits into n 
bits with the distance d ~ itP '^^'^. Note that kVd ■ 
which is quite close to saturating the bound Eq. 



,0.897 




1.5 



1.9 



2.3 

ln(L) 



3.1 3.3 



FIG. 4: The distance of the code defined on a lattice 
Z_L X [0, L — 1] computed numerically using the exhaustive 
search for odd L in the interval 5 < L < 23. 
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